E-Partner: A Photo-Realistic Conversation Agent
نویسندگان
چکیده
An E-Partner is a photo-realistic conversation agent, which has a talking head that not only look photo-realistic but also can have a conversation with the user about a given topic. The conversation is multimedia-enriched in that the E-Partner presents relevant multimedia materials throughout the conversation. To address the challenges presented by the complex conversation domain and task, and to achieve adaptive behaviors, we have derived a novel dialogue manager design consisting of five parts: a domain model, a dialogue model, a discourse model, a task model, and a user model. We also extended existing facial animation techniques to create photo-realistic talking heads that facilitate conversational interactions. Some practical issues like how to handle the uncertainty from speech level are also discussed.
منابع مشابه
On Conversation Policies and the Need for Exceptions
The author describes a system for defining conversation policies that allows conversants to exchange explicit representations of how they use messages to get things done. This system allows conversation policies to be defined for one or more conversation partners. It does not require that every partner be aware of the other’s conversation policies; however, it does provide more capabilities if ...
متن کاملCognitive and Emotional Characteristics of Communication in Human-Human/Human-Agent Interaction
A psychological experiment was conducted to capture the nature of Human-Human and Human-Agent Interactions where humans and computer agents coexist in a collaborative environment. Two factors were manipulated to investigate the influences of the 'schema' about and the 'actual partner' on the characteristics of communication. The first factor, expectation about the partner, was controlled by the...
متن کاملDirection of Attention Perception for Conversation Initiation in Virtual Environments
We consider the role of gaze and direction of attention for providing embodied agents with the capability of visually perceiving the attention of others in a virtual environment. Such a capability is of importance in social environments where the directions in which others orient themselves provides information necessary for detecting important social cues and serving as a basis for inferring i...
متن کاملEffect of levels of realism of mobile-based pedagogical agents on health e-learning
Background: One of the ways for effective communication between learners and instructional multimedia content in mobile learning systems is taking advantage of characters or pedagogical agents. The present study aimed to investigate the effect of the levels of realism in mobile-based pedagogical agents on health e-learning. Methods: The s...
متن کاملBreaking the Ice in Human-Agent Communication: Eye-Gaze Based Initiation of Contact with an Embodied Conversational Agent
In human-human conversation, the first impression decides whether two people feel attracted by each other and whether contact between them will be continued or not. Starting from psychological work on flirting, we implemented an eye-gaze based model of interaction to investigate whether flirting tactics help improve first encounters between a human and an agent. Unlike earlier work, we concentr...
متن کامل